This Page Is Inserted by IFW Operations 
and is not a part of the Official Record 



BEST AVAILABLE IMAGES 

Defective images within this document are accurate representations of 
the original documents submitted by the applicant. 

Defects in the images may include (but are not limited to): 

• BLACK BORDERS 

• TEXT CUT OFF AT TOP, BOTTOM OR SIDES 

• FADED TEXT 

• ILLEGIBLE TEXT 

• SKEWED/SLANTED IMAGES 

• COLORED PHOTOS 

• BLACK OR VERY BLACK AND WHITE DARK PHOTOS 

• GRAY SCALE DOCUMENTS 



IMAGES ARE BEST AVAILABLE COPY. 

As rescanning documents will not correct images, 
please do not report the images to the 
Image Problem Mailbox. 



WORLD INTELLECTUAL PROPERTY ORGANIZATION 
International Bureau 




PCT 

INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(51) International Patent Classification 6 :" 
G06F 19/00 



Al 



(11) International Publication Number: 
(43) International Publication Date: 



WO 98/13782 

2 April 1998 (02.04.98) 



(21) International Application Number: PCT/US97/174I9 

(22) International Filing Date: 26 September 1997 (26.09.97) 



(30) Priority Data: 
08/721,006 



26 September 1996 (26.09.96) US 



(71) Applicant (for all designated States except US): INTERVAL 

RESEARCH CORPORATION [US/US]; Building C, 1801 
Page Mill Road, Palo Alto, CA 94304 (US). 

(72) Inventor; and 

(75) Inventor/Applicant (far US only): TOW, Robert, F. [US/US]; 
13800 Indian Trail Road, Los Gatos, CA 95030 (US). 

(74) Agents: ARTZ, John. A. et al.; Brooks & Kushman, 22nd floor, 
1000 Town Center, Southfield, MI 48075 (US). 



(81) Designated States: AL, AM, AT, AU, AZ. BA, BB, BG, BR, 
BY. CA. CH, CN, CU- CZ, DE, DK, EE. ES. FI, GB, GE, 
GH, HU, ID, IL, IS. JP. KE, KG, KP, KR, KZ, LC, LK, 
LR, LS, LT. LU, LV, MD, MG, MK, MN, MW, MX, NO. 
NZ, PL, PT. RO. RU, SD, SE. SG, SI. SK, SL. TJ, TM, TR ( 
TT. UA. UG, US. UZ, VN, YU. ZW. ARIPO patent (GH, 
KE, LS, MW, SD. SZ, UG, ZW), Eurasian patent (AM. AZ, 
BY, KG, KZ, MD, RU, TJ, TM), European patent (AT, BE, 
CH, DE. DK, ES. FI, FR, GB. GR, IE, IT, LU. MC. NL, 
PT. SE). OAPI patent (BF. BJ, CF. CG, CI, CM, GA, GN, 
ML. MR, NE. SN, TD. TG). 



Published 

With international search report. 

Before the expiration of the time limit for amending the 
claims and to be republished in the event of the receipt of 
amendments. 



(54) Title: AFFECT-BASED ROBOT COMMUNICATION METHODS AND SYSTEMS 



(57) Abstract 

An affect-based method of communication be- 
tween robots is provided by displaying a visual facial 
expression (52) indicative of a simulated emotional state 
on a display device of a first robot, and viewing the vi- 
sual facial expression using a camera on a second robot 
(54). The simulated emotional state may be one of 
happiness, anger, or sadness, for example. The second 
robot determines the simulated emotional state to rede- 
fine its own simulated emotional state (56). and to dis- 
play a visual facial expression indicative thereof. The 
visual facial expression allows a human observer to dis- 
cern the simulated emotional state of the robot. Option- 
ally, the robots further communicate affect using audio 
tones (53). 
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AFFECT-BASED ROBOT 
COMMUNICATION METHODS AND SYSTEMS 

Technical Field 

This invention relates to robots and methods 
5 of communication and operation therefor. 

Background Art 

Desktop-centric paradigms have been universal- 
ly accepted over the past couple of decades to provide 
means for communication and computation to individuals. 

10 A workstation is one example of a desktop-centric 
paradigm. The workstation typically includes input 
devices such as a keyboard, a mouse and a microphone, 
computational resources such as a microprocessor and a 
memory, and output devices such as a display device and 

15 speakers. The input devices, computational resources, 
and output devices of the workstation are located at a 
fixed point, such as on a desk, for utilization by an 
individual. Because of the size and weight of a typical 
desktop workstation, the individual is not likely to 

20 carry the workstation with him/her as he/she traverses 
his/her environment in the course of an average day. 
Hence, the individual typically returns to the fixed- 
point location of the workstation in order to utilize 
its communication and computational resources. 

25 Workstations in the form of portable computers 

are less restricted in being located at a single fixed 
point due to their reduced size and weight. However, 
portable computers only extend the desktop-centric 
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paradigm to a series of fixed points dependent upon 
placement thereof by the individual. Portable computers 
are not amenable to be continually carried by the 
individual as the individual traverses his/her environ- 
ment during the course of an average day. For example, 
an individual would find it highly undesirable to lug a 
portable computer around as he/she walks from each room 
to each other room at home or at work. 

Accordingly, the need exists for an individu- 
al-centric paradigm for computation and/or communication 
as an alternative to the desktop-centric paradigm 
provided by the workstation. The individual -centric 
paradigm would provide computation and/or communication 
at more than a series, of fixed -points . 

Another universally-accepted paradigm is that 
of communicating information between computers using 
modulated signals representative of digital data. The 
modulated signals are formed in accordance with a 
predetermined modulation scheme for communication either 
wirelessly or via a wireline, and using either baseband 
or broadband signals. Typically, these modulated 
signals are not parsable in the realm of the senses of 
a human. Broadband electrical signals, for example, are 
not within the realm of human senses. Telephonic modem 
signals, which are audible for a human to hear, are not 
within the realm of parsing by the human. 



At the 1994 ISAE Conference, an alternative to 
the above-described approaches to computer communication 
was presented. In particular, a semaphore robot was 
30 presented which waved boy- scout semaphore flags to 
display a message entered at a computer keyboard. 
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Another computer located a mile away watched the flags 
with a camera, digitized the images, and. recognized and 
displayed the message. Although a human is capable of 
viewing this form of communication, the human must learn 
5 the semaphore signaling system in order to parse the 
message . 

Summary Of The Invention 

It is an object of the present invention to 
provide a method of machine communication which is 
10 par sable within the realm of human senses. 

A further object of the present invention is 
to provide an individual-centric paradigm as an alterna- 
tive to desktop- centric paradigms. 

In carrying out the above objects, the present 
15 invention provides a robot having a processor which 
executes a sequence of program steps to define a first 
internal state . A display device communicates with the 
processor to display a first visual facial expression 
indicative of the first internal state. A camera 
20 communicates with the processor to view a second visual 
facial expression from a like robot. Based upon the 
second visual facial expression viewed by the camera, 
the processor determines a second internal state of the 
like robot . 

25 in preferred embodiments of the present 

invention, the first and second internal states are 
simulated emotional states of the robots. The simulated 
emotional states are selected from such emotions as 
anger, fear, sadness, and happiness. Corresponding to 
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these simulated emotional states are visual facial 
expressions which allow a human observer to. discern the 
simulated emotional state of the robot. 

The robot, in a preferred embodiment, further 
includes an auditory input sensor to sense a vocal 
signal produced by a human. A voice analyzer is provid- 
ed to analyze the vocal signal to detect an affect of 
the human. The processor processes the affect detected 
by the voice analyzer along with the second internal 
state of the like robot to redefine the robot's first 
internal state. A genetic algorithm is utilized by the 
processor to process the affect and the second internal 
state to redefine the first internal state. 

Further in the preferred embodiment, the robot 
includes a transport mechanism for posit ioning . the robot 
within an environment based upon a control signal. An 
object sensor is provided in communication with the 
processor to detect a position of an object within the 
environment of the robot. The processor generates the 
control signal to position the robot based upon the 
position of the object. The object which is detected 
can be either a human or the like robot within the 
environment of the robot . The transport mechanism and 
the object sensor can be utilized to position the robot 
to facilitate communication with either the human or the 
like robot. Alternatively, the transport mechanism and 
the object sensor can be utilized to move the robot in 
synchrony with movements of either the human or the like 
robot . 



30 



Embodiments of the present invention are 
advantageous in providing non- semantic communication 
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between robots in a way that is also parsable by people. 
Further, the robots advantageously provide an individu- 
al-centric paradigm by operating in. packs or flocks 
about humans . 

5 These and other features, aspects, and advan- 

tages of the present invention will become better 
understood with regard to the following description, 
appended claims, and accompanying drawings.. 

Brief Description Of The Drawings 

10 FIGURE 1 is a flow chart of an embodiment of 

a method of communicating an internal state of a first 
robot to a second robot; 

FIGURE 2 is a block diagram of an embodiment 
of a robot in accordance with the present invention; 

15 FIGURE 3 is a flow chart of a method of 

operating a robot in accordance with embodiments of the 
present invention; 

FIGURE 4 is a flow chart of a method of 
positioning a robot; 

20 FIGURE 5 is a flow chart of a method of 

sensing the affect of a human for use in controlling the 
operation of the robot; 



25 



FIGURE 6 is a flow chart of a method of 
communicating an internal state of a first robot to a 
second robot using a series of audio tones; 
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FIGURE 7 is an environmental .. view of three 
robots in accordance with the present invention; and 

FIGURE 8 is a second environmental view of the 
three robots . 

Best Mode F or Carrying Out The Invention 

Turning now to Figure 1, there is shown a 
method of communicating an internal state of a first 
robot to a second robot. As indicated by block 20, the 
method includes the step of displaying a visual facial 
expression indicative of the internal state of the first 
robot. Preferably, the internal state is a simulated 
emotional state of the first robot, and the visual 
facial expression corresponds to this simulated emotion- 
al state. For example, the simulated emotional state 
15 may be selected from such emotions as anger, fear, 
sadness and happiness. Corresponding to these simulated 
emotional states are visual facial expressions such as 
an anger visual facial expression, a fear visual facial 
expression, a sadness visual facial, expression, and a 
20 happiness visual facial expression. It is preferred 
that these visual facial expressions be discernable by 
a human observer . 

The method further includes a step of viewing 
the visual facial expression using the second robot, as 

25 indicated by block 22. The visual facial expression may 
be viewed on the second robot using an onboard camera. 
Based upon the visual facial expression which is viewed, 
the second robot performs a step of determining the 
internal state of the first robot, as indicated by block 

30 24. As a result, a method of non-semantic communication 
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between robots is provided in a way that is also pars- 
able by human observers. Further, the robots communi- 
cate affect, that is, feeling or emotion particularly 
directed toward action. 

5 Referring to Figure 2, there is shown a block 

diagram of an embodiment of a robot in accordance with 
the present invention. The robot includes a processor 
3 0 which executes a sequence of program steps to define 
a first internal state of the robot. The processor 30 
10 can be in the form of a single board computer which 
controls the operation of the robot. If desired or 
required, the processor 30 can include an off-board 
computing system. 

A display device 32 is provided in communica- 
15 tion with the processor 30. The display device 32 can 
be embodied using any of a number of display technolo- 
gies, such as liquid crystals, light -emitting diodes, or 
a cathode-ray tube. The display device 32 displays a 
first visual facial expression indicative of the first 
20 internal state of the robot. Preferably, the first 
internal state is a simulated emotional state of the 
robot, and the first visual facial expression is select- 
ed from a plurality of visual facial expressions repre- 
sentative of various emotional states. 

25 At the very least, it is preferred that the 

plurality of visual facial expressions include an anger 
expression, a sadness expression, and a happiness 
expression. These visual facial expressions correspond 
to simulated emotional states of anger, sadness, and 

3 0 happiness. In general, the robot can be capable of 
displaying any of a number of emotions. These emotions 
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include, but are not limited to, pain, weeping, suffer- 
ing, low spirits, grief, dejection, despair, anxiety, 
joy, high spirits, love, devotion, reflection, medita- 
tion, ill-temper, sulkiness, determination, hatred, 
5 anger, disdain, contempt, disgust, guilt, pride, help- 
lessness, patience, affirmation, negation, surprise, 
astonishment, fear, horror, blushing, shame, shyness, 
modesty. These and other emotions are described in "The 
Expression of the Emotions in Man and Animals" by 
10 Charles Darwin. Darwin describes a number of basic 
visual emotional displays for all mammals that are 
expressive and well understood by humans." Hence, it is 
preferred that the first visual facial expression be 
discernable by a human observer. 



15 



A camera 34 is provided in communication with 
the processor 30 to view a second visual facial expres- 
sion displayed from a like robot. The camera 34 commu- 
nicates a digitized representation of the second visual 
facial expression to the processor 30, which in turn 
determines a second internal state of the like robot. 
Preferably, the second internal state of the like robot 
is a simulated emotional state corresponding to the 
visual facial expression which is displayed. Further, 
it is preferred that the second visual facial expression 
25 also be discernable by a human observer. 
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The robot includes a transport mechanism 3 6 
for positioning the robot within an environment based 
upon a control signal. The transport mechanism 36 can 
comprise, for example, a plurality of wheels driven by 
one or more motors controlled by the control signal. 
The control signal is generated by the processor 30 for 
controlling the transport mechanism 36. 
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The robot is positioned in dependence upon 
signals provided by an object sensor 38. . The object 
sensor 38 communicates with the processor 3 0 to detect 
a position of an object within the environment of the 
5 robot. The object may be, for example, a human or 
another robot within the robot's environment. The 
object sensor 3 8 can comprise, for example, a direc- 
tional pyrometer. 

The processor 30 generates a control signal to 
10 position the robot based upon the position of the 
object. The control signal may be utilized by the 
transport mechanism 3 6 to position the robot to facili- 
tate communication with either a human observer or 
another robot. The control signal can also be utilized 
15 by the transport mechanism 36 to move the robot in 
synchrony with movements of the human observer or the 
like robot. 

Optionally, an auditory input sensor 4 0 is 
provided to sense a vocal signal produced by a human. 

2 0 The auditory input sensor is coupled to a voice analyzer 

42 which analyzes the vocal signal to detect an affect 
of the human. A signal representative of the affect is 
provided to the processor 30. The processor 30 utilizes 
the affect signal in its execution of the sequence of 
25 program steps. Although illustrated in terms of two 
blocks, it is noted that the voice analyzer 42 and the 
processor 3 0 can be embodied by the same computer. 

As another option, an audio output device 4 4 
is provided to generate a series of audio tones indica- 

3 0 tive of the first internal state of the robot. The 

audio output device 44 can take the form of one or more 
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speakers, for example. An audio input device 4 6 , such 
as a microphone, is provided to receive , A series of 
audio tones indicative of an internal state of a like 
robot. The processor 3 0 determines the internal state 
of the like robot based upon the series of audio tones 
received by the audio input device 46. 



Preferably, the series of audio tones mimic 
bird- like sounds such as chirping sounds.. m one 
embodiment, the chirping sounds have a frequency around 

10 4 KHz. This allows robots to communicate to one another 
using plain old telephone lines. Either the robot 
itself or a human observer can place a telephone handset 
in proximity to the audio output device 44 and the audio 
input device 46 to allow telephonic communication with 

15 another robot. 

The processor 30 processes the visual facial 
expression viewed by the camera 34, and optionally, the 
series of audio tones received by the audio input device 
4 6 and the affect signal produced by the voice analyzer 
4 2 to redefine the first internal state of the robot. 
One approach to redefining the internal state of the 
robot is to utilize a genetic algorithm to process the 
received signals. In particular, the processor 30 can 
utilize a table comprised of a sequence of thresholds. 
Quantities computed by the processor 30 are compared to 
the sequence of thresholds in order to redefine the 
internal state of the robot. The thresholds aire allowed 
to evolve both by mutation and recombination. Other 
evolutionary driving mechanisms which can be incorporat- 
ed in the genetic algorithm include a form of death and 
a form of disease. 



20 
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Figure 3 shows a flow chart of a method of 
operating a robot in accordance with embodiments of the 
present invention. As indicated by block 50, a step of 
executing program steps to define an internal state of 
the robot is performed. These program steps are execut- 
ed utilizing the processor 30. 

. As indicated by block 52, a visual facial 
expression indicative of the internal state of the robot 
is displayed. The visual facial expression is displayed 
using the display device 32. Optionally, the robot 
generates a series of audio tones indicative of its 
internal state, as indicated by block 53. The series of 
audio tones are generated using the audio oucput device 
44 . 



As indicated by block 54, the robot views a 
visual facial expression displayed from another robot. 
The visual facial expression is viewed utilizing the 
camera 34. Optionally, the robot receives a series of 
audio tones generated from another robot, as indicated 
2 0 by block 55. These audio tones are indicative of the 
internal state of the other robot-. The audio tones are 
received using the audio input device 46. 

As indicated by block 56, the robot determines 
the internal state of the other robot using the visual 
25 facial expression viewed by the camera 34. This step of 
processing is performed by the processor 30 . 

As indicated by block 58, the robot senses an 
affect of a human. The affect of the human is sensed 
using the auditory input sensor 4 0 and the voice analyz- 
30 er 42 . 
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Upon performing steps "50-58, flow of the 
method is directed back up to block 50. At^ this point, 
the processor 30 executes a sequence of program steps to 
redefine the internal state of the robot. The internal 
5 state of the robot is redefined based upon the internal 
state of another robot as indicated by either its visual 
facial expression or a series of audio tones. Further, 
the internal state of the robot can be redefined based 
upon the affect of the human. The internal state of the 
10 other robot and the affect of the human can be processed 
using a genetic algorithm to redefine the internal state 
of the robot . 

Turning now to Figure 4, there is shown a flow 
chart of a method of positioning the robot using the 
15 transport mechanism 36. As indicated by block 70, a 
position of an object within an environment of the robot 
is detected. The position of the object is detected 
using the object sensor 38 in communication with the 
processor 30. As noted earlier, the object can include 
a human or another robot within the robot's environment. 



20 



As indicated by block 72 , a step of generating 
a control signal based upon the position of the object 
is performed. The control signal is generated using the 
processor 3 0 within the robot. 

25 As indicated by block 74, a step of position- 

ing the robot based upon the control signal- is per- 
formed. This is accomplished by providing the control 
signal from the processor 30 to the transport mechanism 
36 . 
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Utilizing the above -described steps, the 
transport mechanism 3 6 can position the rpbot to facili- 
tate communication with either a human or another like 
robot. For example, the transport mechanism 3 6 can 
5 position the robot so that its camera 34 can view a 
visual facial expression displayed on a display device 
of another robot. Alternatively, the above -described 
step can cause the transport mechanism to move the robot 
in synchrony with movements of either the human or the 
10 like robot. 

Turning now to Figure 5, there is shown a flow 
chart of a method of sensing the affect of a human for 
use in controlling the operation of the robot. As 
indicated by block 80, a step of sensing a vocal signal 
15 produced by a human is performed. The vocal signal is 
sensed by the auditory input sensor 40, and provided to 
the voice analyzer 42. 

As indicated by block 82, a step of analyzing 
the vocal signal to detect an affect of the human is 
20 performed. The step of analyzing the vocal signal is 
performed by the voice analyzer 42 within the robot. 

A step of processing the affect detected by 
the voice analyzer 42 is performed, as indicated by 
block 84 . More particularly, the affect is processed to 
25 redefine the internal state of the robot. As a result, 
the internal state of the robot can be modified based 
upon the vocal expression of emotion by humans. 

Turning now to Figure 6, there is shown a 
method of communicating an internal state of a first 
30 robot to a second robot using a series of audio tones. 
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As indicated by block 90, a step of generating a series 
of audio tones indicative of a simulated emotional state 
of a robot is performed/ The series of audio tones are 
generated using the audio output device 44 on the first 
5 robot . 

As indicated by block 92, the second robot 
performs a step of receiving the series of audio tones. 
The series of audio tones are received on the second 
robot using its audio input device 46. The second robot 
10 next performs a step of determining the simulated 
emotional state of the first robot based upon the series 
of audio tones, as indicated by block 94. 

Figure 7 is an environmental view of three 
robots constructed in accordance with the present 
15 invention. A first robot 100 has a simulated emotional 
state of happiness as indicated by a happiness facial 
expression displayed on a display device 102. The 
happiness facial expression on the display device 102 is 
discerned by a human observer 104. The first robot 100 
also generates a series of audio tones indicative of its 
simulated happiness state using its audio output device 
106. A vocal signal produced by the human observer 104 
is sensed by an audio input device 108. The vocal 
signal is analyzed to detect its affect, and the affect 
is processed to redefine the simulated emotional state 
of the first robot 100. 

A second robot 110 is displaying a sadness 
facial expression on a display device 112, which is 
indicative of a, simulated emotional state of sadness. 
3 0 An. audio input device 114 receives the series of audio 
tones produced by the robot 100. The second robot 110 
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determines the simulated emotional state of happiness of 
the first robot 100 based upon the series of audio 
tones. This simulated emotional state of the first 
robot 100 is processed by the second robot 110 to 
5 redefine its own simulated emotional state. 

A third robot 120 has a simulated emotional 
state of anger as indicated by an angry facial expres- 
sion displayed on a display device 122. An object 
sensor 124 detects the position of the second robot 110 
10 within its environment. A control signal is generated 
for application to a transport mechanism 126 . The 
transport mechanism 126 positions the third robot 120 to 
facilitate communication with the second robot 110. 

Figure 8 is a second environmental view of the 
15 three robots subsequent to the view in Figure 7 . As a 
result of the affect of the vocal signal produced by the 
human observer 104, the first robot 100 redefined its 
simulated emotional state to one of sadness. This is 
indicated by the sadness facial expression on the 
20 display device 102. The second robot 110 redefined its 
simulated emotional state to one of happiness based upon 
the series of audio tones received from the first robot 
100. This is indicated by the happiness visual facial 
expression displayed on the display device 112. 

25 The third robot 120 is repositioned by the 

transport mechanism 126 to facilitate communication with 
the second robot 110. A camera 128 on the third robot 
120 views the sadness facial expression displayed on the 
display device 112. The third robot 120 determines that 

3 0 the second robot 110 has a simulated emotional state of 
sadness based upon the facial expression. This emotion- 
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al state is processed by the third robot 120 in order to 
redefine its own simulated emotional state.. 

The above-described robots in accordance with 
the present invention are advantageous in communicating 
5 affect, i.e. feeling or emotion, with other robots .and 
people in manners within the; realm of human senses. As 
a result, a form of non-semantic communication between 
robots results which is also parsable by humans. 

Further, the robots define a new paradigm 
10 which is a systematic inversion of the structural 
elements of the workstation. Each of the robots moves 
about, has a developmental history, is social with other 
robots, and is social with people. In comparison to 
workstations utilized at fixed points, the robots of the 
15 present invention operate in packs and flocks about 
humans to form a quantized field. Hence, the new 
paradigm which results is people -centric and body- 
centric, rather than desk- top centric. 
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The physical robots and the software running 
in the robots provide different levels of cybernetic 
organization. The software utilizes the robots as an 
environment for reproduction based upon a genetic 
algorithm. Tables controlling behaviors or emotions are 
modified using the genetic algorithm. A descent-with- 
25 modification evolution results from this reproduction. 

Such an architecture provides a decentralized and highly 
adaptive arena for. both competition and cooperation. 



30 



A plurality of robots in accordance with the 
present invention can be built with the intention of 
creating these flocks.. Additional social behaviors such 
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as predator/prey and dominance hierarchy can be included 
in the robots. These additional social behaviors can be 
static as opposed to the adaptive behaviors described 
herein. 

5 Embodiments of the present invention are 

advantageously interesting and engaging to both children 
and adults. As a result, the robots can take the form 
of toys used for entertainment purposes. Ultimately, 
every person can have several personal robots. Further, 
10 a number of public robots for use by a populace is 
envisioned. 

It is noted that the present invention may be 
used in a wide variety of different constructions 
encompassing many alternatives, modifications, and 
15 variations which are apparent to those with ordinary 
skill in the art. Accordingly, the present invention is 
intended to embrace all such alternatives, modifica- 
tions, and variations as fall within the spirit and 
broad scope of the appended claims. 
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What Is Claimed Ts; 



10 



1. A robot comprising: 

a processor which executes a sequence of 
program steps to define a first internal state of the 
robot ; 

a display device in communication with the 
processor, the display device displaying a first visual 
facial expression indicative of the first internal state 
of the robot, the first visual facial expression select- 
ed from a plurality of visual facial expressions; and 

a camera in communication with the processor 
to view a second visual facial expression from a like 
robot, wherein the processor determines a second inter- 
nal state of the like robot from the second visual 
15 facial expression* 

2 . The robot of claim 1 wherein the first 
internal state is a simulated emotional state of the 
robot, and wherein the second internal state is a 
simulated emotional state of the like robot. 

20 3. The robot of claim l wherein the plurali- 

ty of visual facial expressions includes an anger 
expression, a sadness expression, and a happiness 
expression . 



4. The robot of claim 1 wherein the first 
visual facial expression and the second visual facial 
expression are discernable by a human observer. 

5. The robot of claim 1 further comprising 
a transport mechanism for positioning the robot within 
an environment based upon a control signal, wherein the 
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processor generates the control signal for controlling 
the transport mechanism. 

6. The robot of claim 5 further comprising 
at least one sensor in communication with the processor 

5 to detect a position of an object within the environment 
of the robot, wherein the processor generates the 
control signal to position the robot based upon the 
position of the object. 

7. The robot of claim 6 wherein the object 
10 is a human. 

8. The robot of claim 7 wherein the trans- 
port mechanism positions the robot to facilitate commu- 
nication with the human. 

9. The robot of claim 7 wherein the trans- 
15 port mechanism moves the robot in synchrony with move- 
ments of the human. 

10. The robot of claim 6 wherein the object 
is the like robot. 

11. The robot of claim 10 wherein the trans- 
20 port mechanism positions the robot to facilitate commu- 
nication of the first visual facial expression and the 
second visual facial expression between the robot and 
the like robot. 



25 



12. The robot of claim 10 wherein the trans- 
port mechanism moves the robot in synchrony with move- 
ments of the like robot. 
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13. The robot of claim 1 wherein the proces- 
sor processes the second internal state to redefine the 
first internal state. 

14. The robot of claim 13 wherein the proces- 
sor processes the second internal state using a genetic 
algorithm to redefine the first internal state. 

15. The robot of claim 1 further comprising: 
an auditory input sensor to sense a vocal 

signal produced by a human; and 

a voice analyzer which analyzes the vocal 
signal to detect an affect of the human; 

wherein the processor processes the af v fect 
detected by the voice analyzer to redefine the first 
internal state. 



16. The robot of claim 15 wherein the proces- 
sor processes the affect using a genetic algorithm to 
redefine the first internal state. 



17. A robot comprising: 

an object sensor to detect a position of a 
second robot within an environment of the first robot; 

a transport mechanism for positioning the 
robot within the environment based upon a control 
signal; 

a processor which executes a sequence of 
program steps to define a first simulated emotional 
state of the first robot, and to generate a control 
signal to control the transport mechanism based upon the 
position of the second robot sensed by the object 
sensor, wherein the transport mechanism positions the 
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first robot to facilitate communication with the second 
robot; 

a display device in communication with the 
processor to display a first visual facial expression 
5 indicative of the first simulated emotional state, 
wherein the first visual facial expression is discern- 
able by a human observer; 

a camera in communication with the processor 
to view a second visual facial expression from the 
10 second robot, the second visual facial expression 
indicative of a second simulated emotional state of the 
second robot discernable by the human observer; 

an audio input device in communication with 
the processor to receive a series of audio tones from a 
15 third robot, the series of audio tones indicative of a 

third simulated emotional state of the third robot, the 
audio input device further sensing a vocal signal 
produced by the human observer; and 

a voice analyzer in communication with the 
20 processor to analyze the vocal signal to detect an 
affect of the human observer; 

wherein the processor determines the second 
simulated emotional state of the" second robot from the 
second visual -facial expression and the third simulated 

2 5 emotional state of the third robot, and processes the 

second simulated emotional state, the third simulated 
emotional state, and the affect of the vocal signal to 
redefine the first simulated emotional state. 

18 . A method of operating a robot having a 

3 0 processor, a display device, and a camera, the method 

comprising the steps of: 



• 
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„ executing a sequence of program steps using 
the processor to define a first internal state of the 
robot ; 

displaying a first visual facial expression on 
the display device, the first visual facial expression 
indicative of the first internal state of the robot, the 
first visual facial expression selected from a plurality 
of visual facial expressions; 

viewing a second visual facial expression from 
a like robot using the camera; and 

determining a second internal state of the 
like robot from the second visual facial expression, 

19. The method of claim 18 wherein the first 
internal state is a simulated emotional state of the 

15 robot, and wherein the second internal state is a 
simulated emotional state of the like robot. 

20. The method of claim 18 wherein the 
plurality of visual facial expressions includes an anger 
expression, a sadness expression, and a happiness 

20 expression. 

21. The method of claim 18 wherein the first 
visual facial expression and the second visual facial 
expression are discernable by a human observer. 

22. The method of claim 18 wherein the robot 
25 further includes a transport mechanism for positioning 

the robot within an environment, the method further 
comprising the steps of: 

generating a control signal for controlling 
the transport mechanism; and 
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positioning the robot within the environment 
based upon the control signal . 

23 . The method of claim 22 further comprising 
the step of : 

5 detecting a position of an object within the 

environment of the robot ; 

wherein the control signal is generated to 
position the robot based upon the position of the 
object. 

10-' 24. The method of claim 23 wherein the object 

is a human. 

25. The method of claim 24 wherein the 
transport mechanism* positions the robot to facilitate 
communication with the human. 

15 26 . The method of claim 24 wherein the 

transport mechanism moves the robot in synchrony with 
movements of the human. 

27. The method of claim 23 wherein the object 
is the like robot. 

20 28. The method of claim 27 wherein the 

transport mechanism positions the robot to facilitate 
communication of the first visual facial expression and 
the second visual facial expression between the robot 
and the like robot. 

25 29. The method of claim 27 wherein the 

transport mechanism moves the robot in synchrony with 
movements of the like robot. 
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30. The method of claim 18 further comprising 
the step of processing the second internal- state to 
redefine, the first internal state. 



31. The method of claim 30 wherein the second 
internal state is processed using a genetic algorithm to 
redefine the first internal state. 

32. The method of claim 18 further comprising 
the steps of: 

sensing a vocal signal produced by a human; 
analyzing the vocal signal to detect an affect 
of the human ; and 

processing the affect detected by the voice 
analyzer to redefine the first internal state. 

33. The method of claim 32 wherein the affect 
is processed using a genetic algorithm to redefine the 
first internal state. 



34. A method of operating a first robot 
having a processor, a display device, a camera, and a 
transport mechanism, the method comprising the steps of: 
detecting a position of a second robot within 
an environment of the first robots- 
generating a control signal to control the 
transport mechanism based upon the position of the 
second robot, wherein the transport mechanism positions 
the first robot to facilitate communication with the 
second robot; 

executing a sequence of program steps using 
the processor to define a first simulated emotional 
state of the first robot; 
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displaying a first visual facial expression on 
the display device, the first visual facial expression 
indicative of the first simulated emotional state of the 
first robot and discernable by a human observer; 
5 viewing a second visual facial expression from 

the second robot using the camera, the second visual 
facial expression indicative of a second simulated 
emotional state of the second robot and discernable by 
the human observer; 
10 determining the second simulated emotional 

state of the second robot from the second visual facial 
expressioti; 

receiving a series of audio tones from a third 
robot, the series of audio tones indicative of a third 
15 simulated emotional state of the third robot; 

sensing a" vocal signal produced by the human 

observer ; 

analyzing the vocal signal to detect an affect 
of the human observer; and 
20 processing the second simulated emotional 

state, the third internal state, and the affect to 
redefine the first simulated emotional state. 

35. A method of communicating an internal 
state of a first robot to a second robot, the method 
25 comprising the steps of: 

displaying one of a plurality of visual facial 
expressions using a display device on the first robot, 
the one of the visual facial expressions being indica- 
tive of the internal state of the first robot; 
30 viewing the one of the visual facial expres- 

sions using a camera on the second robot; and 
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determining the internal state of the first 
robot based upon the one of the visual facial expres- 
sions viewed by the second robot. 

36* The method of claim 35 wherein the 
5 internal state is a simulated emotional state of the 
first robot. 

37. .The method of claim 35 wherein the 
plurality of visual facial expressions includes an anger 
expression, a sadness expression, and a happiness 

10 expression. 

38. The method of claim 35 wherein the visual 
facial expression is discernable by a human observer. 
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